EXPRESS MAIL LABEL NO. EL003506683US 



PATENT 
Docket No. 10237.6 



UNITED STATES PATENT APPLICATION 



of 



Eddie M. Schwalb 
and 
Lee M. Chen 



for 



METHODS AND SYSTEMS FOR MASS CUSTOMIZATION 
OF DIGITAL TELEVISION BROADCASTS IN D ASE ENVIRONMENTS 



KIRTON & McCONKIE 

1800 Eagle Gate Tower 

60 East South Temple 

Salt Lake City, UT 84 1 1 1 -1 004 

(801) 328-3600 



BACKGROUND 

1. Field of the Invention 

The present invention relates generally to Digital Television broadcast systems. 
More particularly, the present invention relates to methods for the mass customization of 
Digital Television Application Software Environment (DASE) broadcasts. 

2. Background Art 

The advent of Digital Television (DTV) has added a new dimension to traditional 
television broadcasting by expanding the types of content that may be broadcasted along 
with standard program content. For example, digital technology allows software 
applications, such as apphcations providing television-based e-commerce capabilities, to be 
broadcasted through DTV broadcast signals. Digital technology also enables advances in 
the area of viewer-customized content. For instance, existing art gives a DTV content 
provider the abihty to let viewers select to watch a movie in either a PG-rated version or in 
an R-rated version. This is done by broadcasting a digital combination of the PG- and R- 
rated movie versions which are then separated and prepared for viewing at a DTV broadcast 
receiver such as a set-top box situated at the viewer's location. 

While digital technology has greatly expanded the horizons of the television 
broadcasting industry, existing art has not had the technology to allow the DTV industry to 
capitalize on the benefits of mass customization. However, the success of Internet as a result 
of its ability to customize advertising content according to individual consumer profiles or 
conduct shows the value of individual user-based customization. For example, major 
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Internet-based entities such as Yahoo!® derive a significant portion of their revenue fi-om 
the mass customization capabilities provided by Internet cookies. In this respect, the 
multimedia broadcasting industry in general, and terrestrial broadcasting in particular, is 
lagging behind the Internet industry. Thus, technology that would allow a single broadcast 
to be mass-customized-i.e., customized so that each individual viewer among the millions of 
television viewers could watch a broadcast tailored according to that individual viewer's 
preferences or profile-would be nothing short of invaluable. 

The National Institute of Standards and Technology (NIST) and the Advanced 
Television Systems Committee (ATSC) are developing a broadcast standard, called the 
Digital Television Application Software Environment (DASE), that sets forth various 
requirements for DTV systems-e.g., requirements for transmitters and receivers of DTV 
broadcast signals-designed to run broadcasted software applications. These transmitters and 
receivers are embodied in the form of a DASE set-top box and conform to DASE standai'ds, 
including standards for a DASE application programming interface (API). Hence, 
technology that is readily compatible with DASE technology, in addition to being able to 
provide mass customization capabilities, would be a particularly valuable advancement in 
the DTV art. 
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SUMMARY AND OBJECTS OF THE INVENTION 

The present invention may be characterized generally as a software system that 
enables the mass customization of Digital Television broadcasts through the broadcasting of 
commercials in the form of software applications. Ad-applications are injected into various 
sub-streams of the transport stream and received in a dormant state by a client-side broadcast 
receiver or set-top box. When a service provider, such as a cable TV provider, desires to 
show an ad, the service provider broadcasts a generic trigger that causes ad-apphcations at 
the receiver to execute upon receipt of the trigger. The trigger is time-stamped to indicate 
the time at which the ad-appUcation is to execute. 

A dispatching application located at the chent side receives the generic trigger and 
performs an algorithm to decide which ad-application among those received at the receiver 
is to be executed. The dispatching apphcation compares content keywords, indicative of the 
type of ad content associated with the ad-applications, with viewer keywords, indicative of 
the individual viewer's preferences or profile. The dispatching apphcation uses the resuhs 
of the latter comparison to decide which specific dormant ad-application to route to; it then 
converts the generic trigger into a chosen-ad trigger that is routed to the chosen ad- 
application. Upon receipt of the chosen-ad trigger, the chosen ad-apphcation executes, 
thereby displaying an ad customized to the individual viewer's interests. 

Thus, the present invention provides a method, using ad-apphcations and triggers, 
for customizing a single uniform broadcast to fit the preferences of individual viewers. One 
practical application of the present invention results in the ability to mass customize 
commercials to best fit the personal interests of each viewer, further resulting in better 
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targeted commercials and simultaneously benefitting the viewer and advertiser. In addition, 
this mass customization enables an arbitrary increase in broadcast advertisement time 
capacity, thereby further increasing the availability of a critical revenue source for 
broadcasters. All this is achieved without requiring extensive upgrades to existing DTV 
infi-astructures and, at least in the preferred embodiments of the present invention, without 
sending individual viewer information back to the server. 

Accordingly, it is an object of some embodiments of the present invention to 
provide a Digital Television broadcasting system that enables, through broadcasting 
advertising content in the form of dormant applications, the mass customization of a single 
broadcast without requiring communication back to the server. 

Another object of some embodiments of the present invention is to provide a 
Digital Television broadcasting system including broadcasted elements such as ad- 
applications, event triggers, and a dedicated dispatching application that sends the event 
triggers to the appropriate ad-apphcation, selected by a keyword matching algorithm, for 
activation of that ad-application. 

A further object of some embodiments of the present invention is to provide a 
Digital Television broadcasting system that provides for the mass customization of a single 
broadcast without the need for synchronized broadcast sub-streams. 

Yet another object of some embodiments of the present invention is to provide a 
Digital Television broadcasting system that provides customized advertisement sequences 
through the use of ad-applications and event triggers. 
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Another object of some embodiments of the present invention is to provide a DASE 
Digital Television broadcasting system that fits easily into existing DTV infi-astructures and 
that can efficiently mass customize commercials according to individual viewer interests. 

Another object of some embodiments of the present invention is to provide a DASE 
Digital Television broadcasting system that uses ad-appKcations, triggers, and a keyword 
matching algorithm to provide a customized advertisement stream for each individual 
viewer. 

A further object of some embodiments of the present invention is to provide a 
Digital Television broadcasting system having a dispatching application that routes an ad- 
application trigger to an ad-apphcation selected according to each individual viewer's 
interests. 

Yet another object of some embodiments of the present invention is to provide a 
Digital Television broadcasting system that can create a customized advertisement stream, 
through the use of triggers, without sending individual viewer information back to the 
server. 

A further object of some embodiments of the present invention is to provide a 
Digital Television broadcasting system that improves the viewer's experience by omitting 
ads not related to the viewer's interests. 

Another object of some embodiments of the present invention is to provide a 
Digital Television broadcasting system that increases overall advertisement time and 
capacity. 
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These and other objects and features of the present invention will become more 
fully apparent from the following description, drawings, and the appended claims. Other 
objects will likewise become apparent from the practice of the invention as set forth 
hereafter. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The foregoing and other objects and features of the present invention will become 
more fully apparent from the accompanying drawings when considered in conjunction with 
the following description and appended claims. Although the drawings depict only typical 
embodiments of the invention and are thus not to be deemed limiting of the invention's 
scope, the accompanying drawings help explain the invention in added detail 

Figure 1 illustrates the general environment of some embodiments of the present 
invention; 

Figure 2 is a schematic diagram of the sub-streams and combined displayed stream 
according to some embodiments of the present invention; 

Figure 3 illustrates the general manner in which DTV broadcasters use triggers to 
wake up a dormant software apphcation; and 

Figure 4 shows, in accordance with the preferred embodiments of the present 
invention, how a generic trigger is routed to the dispatching application for selection of 
which ad-apphcation to wake up. 
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DETAILED DESCRIPTION OF EMBODIMENTS OF THE PRESENT INVENTION 



The following detailed description, in conjunction with the accompanying drawings 
(hereby expressly incorporated as part of this detailed description), sets forth specific 
numbers, materials, and configurations in order to provide a thorough understanding of the 
present invention. In other instances, well-known features are omitted or simphfied so as 
not to obscure the invention. However, the following detailed description in conjunction the 
drawings will enable one skilled in the art to make and use the present invention even absent 
the omitted details. 

The purpose of this detailed description being to describe the invention so as to 
enable one skilled in the art to make and use the present invention, the following description 
sets forth various specific examples, also referred to as "embodiments," of the present 
invention. While the invention is described in conjunction with specific embodiments, it 
will be understood, because the embodiments are for explanatory purposes only, that this 
description is not intended to limit the invention to these particular embodiments. Indeed, it 
is emphasized that the present invention can be embodied or performed in a variety of ways; 
the detailed description and the drawings do not limit the scope of the invention because the 
substantive scope of the present invention is to be limited only by the appended claims. The 
drawings and detailed description are merely representative of particular embodiments of the 
present invention. 

It should be noted that because some embodiments of the present invention are 
computer-implemented, the present invention includes embodiments that range fi-om 
computer-executable instructions as part of computer readable media to hardware used in 
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any or all of the depicted structures. Implementation may additionally be combinations of 
hardware and computer-executable instructions. For brevity, computer readable media 
having computer-executable instructions may also be referred to as "software" or "computer 
software." 

5 Reference will now be made in detail to several embodiments of the invention. The 

various embodiments will be described in conjunction with the accompanying drawings 
wherein hke elements are designated by like alphanimieric characters throughout. 

The present invention may be characterized generally as a software-based system 
for use with a Digital Television (DTV) broadcast receiver. Commercials are broadcast in 

10 the form of software apphcations that are injected into various sub-streams of the transport 
stream and received in a dormant state by the client-side set-top box. When a broadcaster 
wants to show commercials, the broadcaster broadcasts a generic time-stamped trigger to a 
client-side dispatching application that performs an algorithm to decide which ad-application 
among those received at the receiver is to be executed. The dispatching application then 

15 converts the generic trigger into a chosen-ad trigger and routes the latter to the chosen ad- 
apphcation. Upon receipt of the chosen-ad trigger, the chosen ad-application executes, 
thereby displaying an ad customized to the individual viewer's interests. 

With reference now to the accompanying drawings. Figure 1 shows the general 
environment of the present invention, A service/content provider 10, e.g., a television 

20 station program provider, cable TV provider, or Internet web site, transmits a broadcast or 
transport stream 12. The transport stream 12 is received by a chent-side broadcast rendering 
device or receiver 14 (here shown as a DASE set-top box) that is adapted to detect the 
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transport stream 12 and prepare the content therein for display on a client-side display 16. 
The display can be any sort of suitable television display, including a wide screen TV, a flat 
screen TV, an HDTVj or a computer monitor. 

The transport stream 12 comprises multiple alternative sub-streams or sub-channels 
5 18 (shown schematically in Figure 2) that are merged/multiplexed together into the transport 
stream 12 so that the display 16 can selectively display any one of the alternative sub- 
streams 18 at a time, resulting effectively in the display of a combined stream 20 that 
comprises a sequence of alternating sub-streams 18. Alternatively, two or more combined 
streams 20 may be displayed on the display 16-such as in a picture-in-picture display. 

10 The alternative sub-streams 18 contain various types of audio, video, and data 

content including, but not Umited to, television and cable programs, commercial 
advertisements, web content, stock reports, telephone directories, and electronic coupons 
that an attached computer can print out. In the preferred embodiments, the transport stream 
12 is broadcast in a format that does not need an upstream chaimel for the receiver 14 to 

15 indicate which alternative media sub-stream 18 segment to view. Also, in the preferred 
embodiments of the present invention, the transport stream 12 is a Digital TV Application 
Software Environment (DASE) broadcast stream that is able to transport software 
components called DASE applications (e.g., e-commerce applications) that are designed to 
be run on the client-side broadcast rendering machine 14. 

20 One important aspect of the present invention is the use of triggers/events that 

"wake up" or activate "dormant" software apphcations broadcasted via the transport stream 
12. These triggers are event data structures as described, for example, by the standards of 
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the ATSC Data Broadcast Standard (A90) and ATSC DASE. The triggers are injected into 
the transport stream 12 preferably at the time that the sub-streams 18 are 
merged/muhiplexed. Triggers could be transmitted as meta-data attached to the sub-stream 
18 video frames (or fields). The means for transmitting these event triggers may be any 
standard means; however, the preferred means is one that conforms to ATSC standards. 
Moreover, the means for exposing the triggers to the target application can be any standard 
device or means. Again, the preferred mechanism, however, would be one that conforms to 
ATSC standards. 

Another important aspect of the present invention involves the broadcasting of ad- 
applications to be "woken up'Vactivated by the triggers. In other words, instead of being 
sent in the form of passive video clips, ads or commercials are sent in the form of dormant 
software applications-whether declarative (e.g., HTML) or procedural (e.g., Java) 
applications. The ad-applications are injected into the transport stream 12 and loaded at the 
chent end by the set-top box or broadcast receiver 16. At the chent end, the dormant ad- 
application then awaits the receipt of a broadcasted trigger to instruct the ad-application as to 
when to execute. Upon execution, the ad-application displays an ad, or series of ads, on the 
display 16. 

In the preferred embodiments of the present invention, the broadcaster/service 
provider 10 transmits a generic trigger via the transport stream 12 when the broadcaster 
desires to display a commercial or series of commercials. This generic trigger is designed to 
activate the ad-apphcations. However, in the preferred embodiments, the receiver 14, 
instead of routing the generic trigger directly to an ad-application, routes the generic trigger 
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to a dispatching application. The dispatching apphcation first chooses which of the ad- 
apphcations in the various sub-streams 18 are to be executed; it then converts the generic 
trigger into a chosen-ad trigger and routes the chosen-ad trigger to the chosen ad-application. 
Upon receipt of the chosen-ad trigger, the chosen ad-application executes and displays its ad 
or series of ads on the display 16. 

Various methods can be used to determine which ad-application is chosen for 
execution. In the preferred embodiments, keyword metrics is used to customize the 
displayed stream 20. For example, content keywords are tagged to the ad-applications to 
represent the content of the ads. These content keywords are tagged to the ad-applications 
by means known in the art and may provide various information about the associated ads. 
The content keywords can be injected into HTML files or Java class files using commercial 
off-the-shelf means. 

As an example of how content keywords operate, the content keywords can identify 
ad content such as "sports ads/' "ads directed to women," "food ads," etc. In the preferred 
embodiments of the present invention, certain sub-streams 18 are designated to carry 
advertising content relating to one specific ad category. For example, one sub-stream 18 
may be designated to carry the sports ads, another sub-stream 18 the food ads, and so forth. 
In another alternative, one or more sub-streams 18 may be designated to carry ad- 
applications of all categories. 

Along with content keywords, the preferred embodiments of the present invention 
also provide for viewer keywords. The viewer keywords indicate the individual viewer's 
preferences or profile and are preferably located on a client-side device that is operatively 
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coupled to the broadcast receiver 14. For example, in the preferred embodiments, the viewer 
enters keywords (e.g., through selecting from a list of selections displayed on the display 16) 
that represent his or her preferences or interests. The viewer who is interested in sports 
might choose to limit the commercials shown on display 16 to sports ads and accordingly 
select "sports ads" from a list presented on the display 16, The viewer might make such a 
selection using a user input device such as a remote control. 

Alternatively or additionally, the viewer keywords may represent a viewer profile 
that is automatically generated as a consequence of user input-similar to the manner in 
which Internet cookies can gather user information. For example, when the viewer selects a 
certain type of program to watch (for example, a sports program), the broadcast receiver 14, 
or other device operatively coupled to the broadcast receiver 14, may store one or more 
viewer keywords (e.g., "sports") corresponding to or relating to the viewer's selection. 

When the dispatching application receives a generic trigger, the dispatching 
application accesses both the content keywords of each dormant ad-application currently 
present at the receiver 14 as well as the viewer keywords. Subsequently, the two types of 
keywords are compared by calculating a match score, here designated as "d." In one 
embodiment, match score d is a quantitative value representative of the degree of match 
between the content keywords and the viewer keywords. For example, the values of d might 
be assigned to range between 0 and 1, where 1 indicates a perfect match and 0 indicates no 
match. It is contemplated that the match score d is to be calculated by means known in the 
art such as by web search engine technology that allows users to pull up a list of various web 
sites upon the entering of one or more keywords. 
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Once the match scores for all the ad-applications in each sub-stream 18 are 
compared, the dispatching appUcation, in some embodiments, selects the ad-application 
producing the best match score d and converts the generic trigger into a chosen-ad trigger 
that is routed to the selected ad-appUcation. Subsequently, the selected ad-apphcation 
executes at the appropriate time designated by the trigger, and the display 16 is switched to 
show the ad or series of ads contained within the ad-application. As a result, to return again 
to the example of the case wherein the viewer keywords relate to sports, the dispatching 
application routes all the generic triggers to sports-related ad-applications, consequently 
resulting in a customized ad sequence of sports ads shown on display 16. 

The use of the dispatching application to route the generic trigger differently for 
each receiver 14 thus enables the mass customization of a television broadcast in that it can 
customize a single broadcast for each individual viewer so that each viewer views a 
broadcast sequence tailored according to that individual's preferences. For example, one 
particular viewer's display might be customized to show health-related ads; another might 
show parenting-related ads; yet another might display sports-related ads. As a result, any 
one of the commercials positioned within the various sub-streams 18 is potentially viewable 
by viewers, thereby significantly increasing the total number of viewable commercials. In 
fact, theoretically, the total number of distinct customized displayed streams 20 that can be 
assembled Jfrom k sub-streams 1 8-each sub-stream 1 8 having n number of ad-applications-is 
k^. Therefore, the total number of custom broadcasts grows exponentially with the number 
of ad-apphcations and the number of individual sub-streams, effectively increasing 
advertisement time capacity significantly. 
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It is important to note that, with respect to the keyword matching algorithm, instead 
of switching to the ad-appUcation with the "best" match value, switching may be determined 
by other means. For example, in some embodiments of the present invention, an ad- 
application might be chosen based on whether the match score meets a designated threshold 
5 value. For example, the dispatching application might choose for display the first ad- 
appUcation to produce a match score meeting a designated threshold value. 

Also, in the preferred embodiments of the present invention, the viewer keywords 
are not sent back to the service provider 10. Thus, the preferred embodiments are able to 
customize broadcasts without requiring a viewer login procedure and without 
10 communicating personal viewer information to the server, thereby protecting the privacy of 
viewers by not disclosing to the broadcaster the viewer preferences or the specific broadcast 
combination displayed on display 16. In other embodiments of the present invention, a 
return channel (not shown) containing viewer preference information or keywords is used to 
enable the broadcaster and the advertisers to obtain statistic market reach information. 
15 However, these embodiments having a retum channel are not the preferred embodiments 
because they eliminate the above-mentioned advantage of protecting viewer privacy. 

It should also be noted that the dispatching appUcation may be broadcast to the set- 
top box or receiver 14 by the content provider 10 in the same way that all other DASE 
software applications are broadcast. Altematively, the dispatching application can come 
20 pre-loaded on the set-top box/receiver 14. 

The timing of the present invention is controlled by the triggers because they contain 
information indicative of the time at which the ad-application is to execute. It will be noted that 
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the service provider 10 must transmit the generic trigger early enough so as to allow sufficient 
time for its broadcast transmission, the performance of the above-discussed matching algorithm, 
and the conversion of the generic trigger into a chosen-ad trigger. Also, in the preferred 
embodiments, the triggers are time-stamped to indicate the time at which the matching 
algorithm must start and at which the ad-apphcations are to be executed. Such time stamps are 
well known in the art and typically comprise a fixed number of bits (e.g., 32 bits) within the 
sub-streams 18. 

Turning now to Figure 3, one can see the general manner in which DTV broadcasters 
use triggers to wake up a dormant software application. First, as shown at 22, the broadcaster 
10 broadcasts a software apphcation via the transport stream 12 and waits until that application 
is paused at the receiver 14. Next, as shown at 24, the broadcaster 10 broadcasts an event or 
trigger via the transport stream 12. Upon receipt of the trigger, the receiver 14 identifies the 
target apphcation 26 and sends the event information to the latter apphcation 28. When the 
apphcation receives the trigger, it "awakes' -i.e., it executes-and pauses 30 for the cycle to 
potentially repeat again when another trigger is received. 

Figure 4 shows how the preferred embodiments of the present invention involve the 
use of a dispatching application to route the trigger to a specific ad-apphcation. Here, the 
broadcaster 10 injects ad-applications into the broadcast stream 32; the client-side receiver 14 
downloads the ad-applications into memory 34; the broadcaster 10 sends an event using a 
generic trigger 36; the receiver 14 receives the trigger 38; and the receiver 14 routes the generic 
trigger to a dispatching application 40. The dispatching apphcation then determines which 
cached ad-application to route the trigger to (effectively converting the generic trigger into a 
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chosen-ad trigger) by using, in the preferred embodiments, keyword metrics 42. The receiver 
14 then awakes the selected ad-apphcation 44 and displays the ad associated with the ad- 
application 46. The displayed ad is displayed on the display 16 and may include a graphical 
user interface (GUI). As with the process outlined in Figure 3, this process may be repeated 
5 when another trigger is sent. 

It should be emphasized that the present invention may be embodied in various specific 
forms without departing from the scope of the present invention. For example, High Definition 
Television (HDTV) broadcasts come within the scope of the present invention as well as 
standard DTV broadcasts. Also, the present invention may be operable in both wired and 

10 wireless environments. 

Further, in some embodiments of the present invention, the methods of the present 
invention can be incorporated into a hierarchical video stream merging apparatus, whereby the 
merged stream contains multiple sub-streams, each customized to contain local content such as 
local advertisements. In some embodiments, the methods of the present invention may be 

1 5 employed by means of a card for a personal computer that tums the computer into a set-top box 
of sorts. Such a card accepts and decodes ATSC signals for feeding to a DTV. 

In brief, the present invention provides a method and system for the mass 
customization of Digital Television broadcasts through the broadcast of commercials in the 
form of dormant software applications. Practical application of the present invention enables 

20 the automatic selection of commercials that best fit the personal interests of each viewer, 
resulting in better targeted commercials while simultaneously benefitting the viewer and 
advertiser. The present invention can improve the viewer's experience by omitting ads not 
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related to the viewer's interests as well as by automatically adjusting a broadcast schedule to 
better fit a viewer' s schedule. In addition, this mass customization enables an arbitrary increase 
in broadcast advertisement time capacity, thereby further increasing the availability of a critical 
revenue source for broadcasters. Moreover, in the preferred embodiments of the present 
invention, all this is achieved without sending individual viewer information back to the server. 

It is again emphasized that the present invention may be embodied in other specific 
forms without departing firom its spirit or essential characteristics. The described embodiments 
herein should be deemed only as illustrative. Indeed, the appended claims indicate the scope 
of the invention; the description, being used for illustrative purposes, does not hmit the scope 
of the invention. All variations, alternatives, modifications, and equivalents that come within 
the meaning and range of equivalency of the claims are to be embraced within the scope of the 
claims. 

What is claimed is: 
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